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Continuous-time random walks (CTRW) play important role in understanding of 
a wide range of phenomena. However, most theoretical studies of these models con- 
centrate only on stationary-state dynamics. We present a new theoretical approach, 
based on generalized master equations picture, that allowed us to obtain explicit 
expressions for Laplace transforms for all dynamic quantities for different CTRW 
models. This theoretical method leads to the effective description of CTRW at all 
times. Specific calculations are performed for homogeneous, periodic models and for 
CTRW with irreversible detachments. The approach to stationary states for CTRW 
is analyzed. Our results are also used to analyze generalized fluctuations theorem. 
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I. INTRODUCTION 

Continuous-time random walks (CTRW) are discreet models where particle transitions 
between different states are controlled by random waiting-time distribution functions.- 1 ^ 
CTRW is a powerful tool in studying dynamic processes in chemistry, physics, biology, so- 
cial sciences and economics.— ^"Z^ These models are especially convenient for investigation 
transport processes where deviations from the classical diffusion picture are observed.- 1 ^ 
Recently, CTRW have been successfully utilized for analyzing single-molecule enzyme 
kinetics,— dynamics of motor proteins,— 1 ^ and transport of metabolites across biological 
channels. 13 

The majority of theoretical studies of CTRW address only dynamics at large times, i.e., 
the stationary-state properties.- 1 ^ But one might question the applicability of these results for 
understanding different processes since it is frequently not clear if the studied system reached 
the steady-state conditions. Strong advances in experimental techniques, especially in single- 
molecule biophysics and cellular transport, have provided us with a comprehensive full-time 
description of many complex phenomena. It is reasonable to suggest that a theoretical 
method that permits a calculation of dynamic properties of the system at all times will 
provide a much better understanding of underlying mechanisms. The original work on 
CTRW- suggested a combined Laplace-Fourier transforms as a way to describe dynamics 
at all times. But these results, although formally correct, are technically impossible to 
apply for analyzing real systems. Recently, Berezhkovskii and Weiss*^ introduced a new 
elegant method of computing exactly Laplace transforms of dynamics properties of CTRW. 
They successfully analyzed first two moments of the displacement of the random walker, 
the asymptotic behavior of the moments at large times, and the effective diffusion constant. 
However, this method has been developed only for homogeneous CTRW with the same set 
of waiting-time distribution functions at each site, and it is not clear how to extend it for 
more complex CTRW models. 

In this paper we develop an alternative approach for calculating dynamics proper- 
ties in complex CTRW models at all times. Utilizing the generalized master-equations 
description^^ it is shown how all Laplace transforms can be obtained explicitly for several 
complex CTRW model. 
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II. HOMOGENEOUS CTRW 

To proceed, consider first the sequential CTRW kinetic model as shown in Fig. 1. The 
dynamics of the random walker is specified by waiting-time distribution functions ipf{t) 
and ipj(t). We define ip~j(f)dt as the probability of jumping one step forward from the 
state j between times t and t + dt after arriving to the state j. Similarly, ip~(t)dt is the 
corresponding probability to move backward, while tpj(t)dt determines the probability of 
irreversible detachment (or death) from the state j at the same time interval. To illustrate 
our theoretical method, we will first analyze in detail the simplest homogeneous CTRW 
model with (i) = ^(t) to be independent of the state j and without detachments 
[$(t) = for all j]. 

Our theory is based on the crucial observation, presented first by Landman, Montroll and 
Shlesinger in 1977, 3 that the probability P n (t) of finding the random walker at the site n 
at time t (assuming that at t — it started at n — 0) is governed by a generalized master 
equation 

dP n (t) 



dt 



{<p + (r)P n ^(t - r) + <p-(r)P n+1 (t - r) - [<p + (r) + <p-(r)]P n (t - r)} dr, (1) 
o 

where waiting-time rate distributions ip^it)^- are related to waiting-time distribution func- 



tions via Laplace transforms, 



?(s) = j£M (2) 



with ip(s) = ip + {s) + ip (s). Performing Laplace transformation to the generalized master 
equation [Eq.flTJ] leads to 

[s + fi + (s) + lp-(s)] P n (s) = 5 nfl + ^ + (s)P n _i(s) + ip-(s)P n+1 (s). (3) 

After introducing new variables, a = s + (p + (s) + (p~(s), b = tp + (s) and c = tp~(s), this 
equation can be written as 

aP n {s) = S n>0 + bP n -i{s) + cP n+1 (s). (4) 

We can define a new function, R n (s), such that 

fb\ n/2 ~ 

Pn(s) = - Rn(s), (5) 
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and after substituting this relation into Eq. PJ we obtain 

aR n (s) = S n>0 + Vbc[R n ^(s) + R n +i(s)}. (6) 

This equation can be solved by looking for a solution in the form, R n (s) = i?o(s)x' n ', and 
after substituting into Eq. ([6]) it yields 



a ± y/a 2 — 4bc ,_ N 

x= 2VEi ' (7) 



and 

R (s) = 1/Va 2 - Abe. (8) 

Combining Eqs. (5)- (7), one can show that the final expression for the Laplace transform 
of the probability function is given by 



c) V 2Vbc J Va 2 - Abe 
or 

~ (v + {s)Y' 2 ( s + V + (s) + lp-(s) - y/[ 3 + $+(s) + ^{s)f - ggggf(g \ H 

' (10) 



v/[s + p+(s) + <p-(s)} 2 - 4<p+(s)(p-(s) 
It can also be written in terms of waiting-time distribution functions by utilizing Eq. 

M 

Pn(s) 



> \l + yi-4V>+(s)V>-(s), 

l-^(s) 



(11) 



s^l -4^+(s)^-(s) 

This is exactly the expression for the Laplace transform of the probability distribution 
function obtained in Ref.— by a different approach. 

These equations provide a direct way of analyzing dynamics of CTRW at all times. It 
can be shown by calculating explicitly first two moments of the motion. Defining (n(t)) 
as the average position of the random walker at time t, the following expression for the 
corresponding Laplace transform can be found 

<„( S )) = £ nP„(s) = — — = ^i_^U . (12) 
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Similar calculations for the Laplace transform of the second moment produce 

n=— oo * ' 

+ lp-(s)] [s + 2y+(s) + 2$-(s)] - 8$+(s)$-(s) 
s 3 



(13) 



At large times the dynamic behavior of the first and second moments can be found 
by considering the limit of s — > 0. Expanding Laplace transforms of waiting-time rate 
distributions it can be shown that 11 

tp + (s) ~ u + g + s + ■ ■ • , 

<p~(s) ~ w + g~s + • • • , (14) 
where w = <p + (s = 0) and w = <p~(s = 0) are effective transition rates;— and = ^-| s=0 . 



Substituting these expansions into Eqs. (1121) and (1131) . one can find that 

(n(t)) ~ (u-w)* + (<7+-<r), (15) 

and 

(n 2 (t)> ~ (u - u;) 2 t 2 + [{u + w) + i{u - w){g + - g-)]t + 2{g + - g'f + {g + + g~). (16) 

It is interesting to compare the characteristic times after which the dynamic property 
achieves its stationary-state behavior. For the first and for the second moments these char- 
acteristic times are 

t * ~ 9+ ~ 9 (17) 
it — w 

and 

u + w+^a- w)(g + - g~) 
[u — w) 2 

respectively. Then, because t\ > t*, for some time interval the first moment can already 
be in the stationary state, while the second moment have not reach it yet. The applica- 
tion of stationary-state formalism for analyzing CTRW in this regime might lead to wrong 
description of its dynamics. 

From large-time behavior of the moments we could also compute other important dynamic 
properties such as the effective drift velocity V and the effective diffusion constant D. The 
velocity is given by 

v=lim d±{t)l =u _ (ig) 
t^oo dt K J 



6 



The corresponding expression for the diffusion constant is 

f , d(n 2 (t)) - (n(t)) 2 I, , , w , 
D = - im V 1 " V 1 " =-(u + w) + (u- w)(g+ - g~). (20) 
l t^oo at l 

These equations reproduce stationary-state results obtained earlier for periodic iV-state se- 
quential CTRW with N — 1 (the homogeneous case).— 



III. CTRW WITH IRREVERSIBLE DETACHMENTS 

The advantage of using this theoretical approach for computing dynamic properties at 
all times is the fact that it can be easily adopted for more complex CTRW models. Let us 
show this by considering CTRW model with irreversible detachments that presented in Fig. 
1. We will again assume that ipfif) = ^(t) while the detachment waiting-time distribution 
functions are ipj(t) = ip s (t) ^ 0. This system is also homogeneous. 

The probability to find the random walker at the site n at time t if at t = it was at the 
origin is again governed by the corresponding generalized master equation,-^ 
t 

= J ^ + (T)P^ 1 (t-T) + ^-(r)P fH . 1 (t-r)-[ V » + (T) + V> -(T) + /(T)]P n (t-r)dT > (21) 



where tp + (t), f~(t) and <p s (t) are waiting-time rate distributions for moving forward, back- 
ward and to detach, respectively. They can be expressed in terms of original waiting-time 
distribution functions, 

«.) = (22) 

with ift(s) = ip + (s) + if)~(s) + tp s (s) and i = +, — or 5. In this system the probability is not 
conserved, and it is convenient to define a new function Q n (t) defined as^ 

P n (t)=e- xt Q n (t). (23) 

The function Q n (t) has a meaning of the survival probability of reaching the site n at time 
t, and the parameter A is an effective detachment rate for the random walker. Then the 

generalized master equation should be modified as 

t 



dt 



dQn(t) = J{ip + (r)e^ T Qn-i(t-T) + ip-(T)e XT Q n+1 (t-T) - 



[<^ + (r) + ^"(r) + ^{r)]e XT Q n {t - r)} dr + XQ n (t). (24) 
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Then after Laplace transformation this equation produces, 

[a + fi + {s - A) + <p~(s - A) + fi 5 {s - A) - A] Q n {s) = 

8n,o + ¥ + ( s ~ A)Q n _i(s) + $~{ s - \)Q n+ i(s). (25) 

To simplify notations we again define, 

a = s + - A) + fi~(s - A) + tp s (s - A) - A, 
6 = £ + (s-A), 

c = ^~(s - A). (26) 

As shown in the Sec. II, Eq. ( 1251) can be solved to yield the expression for the Laplace 
transform for the survival probability, 

7., , fb\ n ' 2 {a-Va 2 -4bc\ lnl 1 

QM= {c) ( j (2?) 

The corresponding expression for the probability function P n (t) can be easily obtained from 
Eq. m, 

Pn(s)=Qn(s + \). (28) 

Explicit equations for Laplace transforms can be used to calculate behavior of all relevant 
dynamic properties at all times. In this system the first moment is defined as 

( n ( t )\ - L^nW _ En"Qn(*) 

It can be shown that the Laplace transform of the first moment is equal to 

(n( s )) = T, n nQn(s) ^ (3Q) 

Utilizing Eq. (1271) it can be calculated that 

(n(s)) - b ~ C - V + (s-X)-^-(s-X) 

We can also perform similar analysis for the second moment, and it yields 

w {b + c)(a + b + c) -8bc r _ +/ . 
(n 2 (s)) = ± ^ _ - _ ^ = [<p+(s -\) + <p (s - A)] x 

[s + 2^{s - A) + 2y-{s - A) + g(a - A) - A] - 8y+(s - A)£~(s - A) 

s [s + £> _ (s — A) — A] 2 
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The stationary-state behavior of the first and second moments can be found by expanding 
at small s expressions for (f + (s — A), (f~(s — A) and <p 5 (s — A): 

(p + (s — A) ~ u + g + s + ijh + s 2 • • • , 

(f~{s- A) ~ w + g~s + 7^h~s 2 • • • , 

lp 5 (s - A) ~\ + g s a + h 5 s 2 + ■■■ , (33) 

Using these expansions leads us to the following expressions for stationary-state behavior of 
the first and second moments, 

, , (u — w) (q + — q~) (u — w)h s 

tit ~ + ^T Z - i 7 TTTT, 34 

S 1 " (1+^) (l + 9 S ) 2(1 + ^) 2 ' 1 ; 



\'2 



<« 2 W> - fe£< 2 



(u + w) 4(m - w)(g + - g~) 2(u-w) 2 h s 



+ 



t. (35) 



(1+^)2 [(l + g*) {1+gS) 2 {1+g5) 3 

From these results we can easily compute the effective drift velocity, 

v = ^ (36) 

and the effective diffusion constant, 

(m + w) _ (m- w) 2 ^ 

2(1 + g 5 ) (l+g s ) 2 2(1 + ^)3- 1 j 

These equations are identical to the steady-state expressions for V and D obtained earlier 
via a different method.— 1 ^ 



IV. PERIODIC CTRW 

This theoretical method can also be extended for periodic CTRW. Let us consider the 
simplest non-trivial periodic system as shown in Fig. 1 with ipf(t) = ipQ (t) for j even and 
ipf(t) = ipi (t) for j add. This corresponds to the periodic iV-state CTRW model with 
N = 2. Irreversible detachments will be neglected in this case, i.e., if}j(t) = for all j. 

The temporal evolution of the system is described by a system of generalized master 
equations, 



= / ^(rlVift - r) + ft (r)P 2n+1 (« - r) - [^(r) + Vo (r)]P 2n (« - r)dr; 
ipt(r)P 2n (t - r) + ft (r)P 2n+2 (t - r) - [ft+(r) + ft (r)]P 2n+ i(t - r)^38) 



o 

t 



dP 2n +i(t) 
dt 
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As before, waiting-time rate distributions tpf{t) are closely connected to waiting-time dis- 
tribution functions ij)f{t) (i = 0, 1) as given by 

( s ) = : — ~tt> ( 39 ) 
1 - ipi(s) 

for i — or 1, and with ^(s) = ^(s) Laplace transformations change generalized 

master equations into 

[s + ^ (s) + ^ (s)] P 2n (s) = S nfi + (p~t(s)P 2n - 1 {s) + Pi(s)P 2n+1 (s); 
[s + ipt(s) + ^i(s)] P 2n +i(s) = 5 Ui o + ffi(s)P 2n (s) + (s)P 2n+2 (s). (40) 

After introducing the auxiliary functions 

ai = s + fif(s) + &i(s), hi = fil(s) a = tpT(s), (41) 

for i = or 1; and defining P 2n {t) = Q n (t) and P 2n+ i(t) = R n (t), we obtain 

aoQn(s) = S n>0 + hRn-^s) + Ci-R n (s), 

atRnis) = b Q n (s) + c Q n+ i(s). (42) 

Combining these two equations we can write 

AQ n (s) = ai 5 nfl + BQ„_i(s) + CQ n+1 (s), (43) 

where 

A = a ai — bic Q — b ci, B = b bi, C = c ci. (44) 
Eq. (1431) can be solved to produce the Laplace transform for the probability on even sites, 



n n - f A~VA 2 -4BC \ fll _ Z&o&i \ " 

Qn[S) ~\c) { 2VBC J ^A 2 -ABC~WJ 



x 



a ai - 6ic - 6 ci - y (oqQi - hc - 6 ci) 2 - 46 &ic ci 

2^061 c ci 



x 



^(aoai - 6ic - 6 ci) 2 - 46 &ic ci 
Simultaneously, it can be shown that for the odd sites, 



(45) 



R n (s) = -Q n (s) + ^Q n+1 (s). (46) 

fll fll 
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Now we can calculate the dynamic behavior of the first and second moments. For the 
first moment, 

(n{t)) = nP n{t) = 2n Qn{t) + J2( 2n + l ) R n(t)- ( 4 ?) 



Then using explicit expressions for Q n {s) and R n (s), our calculations yield 

b - c , 2(b bi - c d) 



(n(s)} 



+ 



(48) 



s(s + b + bi + c + ci) s 2 (s + b + bi + c + c x ) 
Similar calculations for the Laplace transform of the second moment are quite tedious, but 
the corresponding expression is relatively compact, 

4(&o&i + c ci) 8(6 &i - CoCi) 2 



(n 2 (s)) = v u u ' + - 

s 2 (s + bo + b x + c + c x ) s 3 (s + b + b 1 + c + d) 2 

4(6 &i - c ci)(6 - c ) Oo + co) 



+ 



+ 



(49) 



s 2 (s + 6 + h + c + ci) 2 s(s + 6 + h + c + ci) ' 
At large times, the dynamics can be understood if we use expansions of waiting-time rate 
distribution functions at s — > 0,— 



Then at t 

(n(t)} 



bo = &o( s ) 
h = <?t{s) 

Co = Vo ( s ) 
ci = £f (s) 

00 we have for the first moment, 



Wo + 9o s H , 

Ui+gfs-\ , 

w + 3o s H > 

w i + 9\ s H ■ 



(50) 



2(w wi-wo^i) 2(^1^ + u gf) - 2(w fi'i + wig ) + («o - w ) 



-t + 



(u + U\ + W + W\) (u + Mi + W + Wi) 

2(m Mi - w Wi)(l + 0o" + 9i + 9o + 9i) 



(u + UX + W0 + Wi) 2 

while for the second moment, 

4(m ui - WoWx) 2 2 [ 4(m Mi + lOo^l) 
rt + 



(51) 



(u + Mi + W + U>i) 



4(m «i - w ^i)(m - wo) 



(u + Ui + W7 + Wi) (u + Ui + Wo + WiY 



16(^1^ + u gf - w g 1 - Wig )(u u 1 - Wpw^ 

(uo + Ui + w + u>i) 2 
16(u ui - w wi) 2 (l + ffo" + </i" + <7o + Si") 



i. 



(w + Ml + W + Wl) 3 

These expressions allow us to derive the stationary drift velocity, 

2(u Mi - w Wt) 



V 



(uo + U\ + Wo + Wi) 



(52) 



(53) 
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while for the effective diffusion constant we have, 

D _ 2(u u 1 + w wi) 4(m mi - w wi)(Mig + + u gf - w g± - uh%) 

(u + U X + W + W\) (u + U\ + W + Wi) 2 

4(m mi - ^ wi) 2 (l + gp +gj +%_ + g^) . . 

(u + U\ + w + Wi) 3 

These equations reproduce, as expected, known results for dynamic properties of CTRW at 
stationary-state conditions. 11 Calculations for periodic CTRW models with N > 2 can be 
accomplished following this approach. 



V. GENERALIZED FLUCTUATION THEOREM 



Berezhkovskii and Weiss^ introduced a generalized fluctuation theorem by considering 



the ratio 



Pn(s) 
P-n(s)' 



It was argued that it reduces to the conventional form of the fluctuation 



theorem^^^ under some conditions. For homogeneous CTRW it was found^ [see also our 
Eqs. ([inD and (ED] that 



Pn(s) 


>(*)" 


n 




P-n(s) 


1>-(s) 







It leads to the original fluctuation theorem result when 



(55) 



is time- independent. Our 



calculations allow to extend this result for periodic iV-state CTRW with N = 2. Using Eqs. 
(41) and (45) we obtain, 



P2n{s) 
P-2n(s) 



fo ( g )^( g ) 

.^o( s )^r(s). 



(56) 



It is also interesting to consider the generalized fluctuation theorem for CTRW with irre- 
versible detachments. In this case we obtain from Eqs. (27) and (28) the expression identical 
to Eq. fl55|) . This result is rather surprising, and it suggests that irreversible detachments 
do not affect the ratio of probabilities for the forward and backward steps of the random 
walker, and consequently do not change statistics for occurrence of different fluctuations. 



VI. SUMMARY AND CONCLUSIONS 



A new theoretical approach of computing dynamic properties of CTRW at all times 
is developed. The important critical step of the method is the observation that CTRW 
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dynamics can be described by generalized master equations. It allowed us to compute exactly 
Laplace transforms of probability functions and all other relevant dynamic properties. The 
presented approach is flexible enough to describe complex CTRW systems. Specifically, 
we analyzed homogeneous and periodic homogeneous CTRW, as well as the model with 
irreversible detachments. 

We calculated explicitly how different CTRW models approach their stationary-state dy- 
namics. All derived expressions for dynamic properties at steady states agree with available 
large-time results for CTRW obtained by different methods. Based on these observations it 
is argued that times to reach the steady-state conditions might differ significantly for dif- 
ferent dynamic properties, and one must be careful in applying stationary-state results for 
understanding mechanisms of processes described by CTRW models. We also analyzed the 
generalized fluctuation theorem, and it is found that irreversible detachments do not affect 
much the fluctuation dynamics. It will be interesting to extend this theoretical approach to 
analyze at all times more complex CTRW systems, such as models with branched states^ 
and parallel-chain models.— 1 ^ 
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Figure Captions: 

Fig. I. A general scheme for continuous-time random walk (CTRW) models, ^(t), ip~(t) 
and ipj(t) are waiting-time distribution functions to step forward, backward or to dissociate 
irreversibly, correspondingly. 
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Figure 1. Kolomeisky 



